Edge-distributed fusion of camera-LiDAR for robust moving object localization

نویسندگان

چکیده

Object localization plays a crucial role in computational perception, enabling applications ranging from surveillance to autonomous navigation. This can be leveraged by fusing data cameras and LiDARs (Light Detection Ranging). However, there are challenges employing current fusion methods edge devices, while keeping the process flexible modular. paper presents method for multiple object that fuses LiDAR camera with low-latency, flexibility scalability. Data is obtained 360° surround view four scanning distributed over embedded devices. The proposed technique (a) discriminates dynamic objects scene raw point clouds, clusters their respective points obtain compact representation 3D space (b) asynchronously fuse centroids detection neural networks each detection, localization, tracking. meets above functionalities low-latency increased field of safer navigation, even intermittent flow labels bounding boxes models. That makes our system distributed, modular, scalable agnostic model, distinguishing it state-of-art. Finally, implemented validated both indoor environment publicly available outdoor KITTI 360 set. occurs much faster accurate when compared traditional non-data driven latency competitive other non-embedded deep learning methods. mean error estimated ≈ 5 cm precision 2 navigation 15 m (error percentage 0.3%). Similarly, 30 3 35 on set 0.8%).

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Robust depth-based object tracking from a moving binocular camera

Depth is a rich source of information and has been successfully utilized in numerous computer vision applications. However, it is often ignored in object tracking. In this paper, in contrast to traditional 2D image-based tracking method, we propose a novel 3D object tracking method from a moving binocular camera. To effectively handle the deformable targets, a target is first represented by a l...

متن کامل

Robust Moving Object Detection from a Moving Video Camera Using Neural Network and Kalman Filter

Detecting motion of objects in images, while the camera is moving, is a complicated task. In this paper, we propose a novel method to effectively solve this problem by using Neural Networks and Kalman Filter. This technique uses movement parameters of camera to overcome problems caused by error in image processing outputs. We implemented this technique in the MRL Middle Size Soccer Robots. Expe...

متن کامل

Fusion of 3D-LIDAR and camera data for scene parsing

Fusion of information gathered from multiple sources is essential to build a comprehensive situation picture for autonomous ground vehicles. In this paper, an approach which performs scene parsing and data fusion for a 3DLIDAR scanner (Velodyne HDL-64E) and a video camera is described. First of all, a geometry segmentation algorithm is proposed for detection of obstacles and ground areas from d...

متن کامل

Distributed Localization of Camera Networks

Motivated by applications in ad-hoc camera networks, we present distributed algorithms for the automatic, external, consistent, metric calibration of a network of cameras distributed over a large geographical area with no centralized processor. First, we model the set of uncalibrated cameras as nodes in a communication network, and propose a distributed algorithm in which each camera only commu...

متن کامل

Fixed-Camera Visual Servoing of Moving Object

Visual servo control of robots has been recently considered and developed by many researchers. In this paper we have used a fixed camera for obtaining location and orientation of a moving object on a conveyor belt and then tracking the object. Tracking trajectory is obtained using a new event-based real-time path generation. Using the error signal obtained, which is difference between location ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Access

سال: 2023

ISSN: ['2169-3536']

DOI: https://doi.org/10.1109/access.2023.3295212